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Abstract 


E-learning is part of the new dynamic that characterises educational systems at the start of 
the 21 st century. Like society, the concept of e-learning is subject to constant change. In ad¬ 
dition, it is difficult to come up with a single definition of e-learning that would be accepted 
by the majority of the scientific community. The different understandings of e-learning are 
conditioned by particular professional approaches and interests. 

An international project, based on the participation of experts around the world, was un¬ 
dertaken to agree on a definition of e-learning. To this end, two main research activities 
were carried out. First, an extensive review was conducted of the literature on the concept 
of e-learning, drawing from peer-reviewed journals, specialised web pages, and books. Sec¬ 
ond, a Delphi survey was sent out to gather the opinions of recognised experts in the field 
of education and technology regarding the concept of e-learning with a view to reaching a 
final consensus. 

This paper presents the outcomes of the project, which has resulted in an inclusive defini¬ 
tion of e-learning subject to a high degree of consensus that will provide a useful conceptual 
framework to further identify the different models in which e-learning is developed and 
practiced. 
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Introduction 


In recent decades, the use of information and communication technologies (ICT) for ed¬ 
ucational purposes has increased, and the spread of network technologies has caused e- 
learning practices to evolve significantly (Kahiigi et al., 2008). However, any definition of e- 
learning must settle the issue of what is and what is not e-learning (Guri-Rosenbilt, 2005). 
The multiplicity of perspectives surrounding e-learning causes confusion and, sometimes, 
even contradictions (Mason & Rennie, 2006). Not only have different concepts been at¬ 
tributed to e-learning, but the term has also been substituted by others, such as computer- 
based learning, technology-based training, and computer-based training, which actually 
predate the first mention of e-learning in the mid-1990s (Friesen, 2009) or the more recent 
online learning. Moreover, some people confuse the concept of e-learning with the con¬ 
cepts of a virtual campus or online courses, which can be part of the e-learning universe but 
do not sufficiently define it. 

The evolution of distance education, as a result of new technologies and the contributions 
of computer scientists to the field of education along with the conceptualisation of educa¬ 
tion as a lifelong process, poses a major challenge for educational institutions: how to in¬ 
tegrate these technologies into their organisation and, especially, into their teaching. From 
simple occasional use of ICT to reinforce face-to-face teaching and learning to the use of 
virtual environments for courses conducted completely online according to a variety of edu¬ 
cational models, the incorporation of ICT into the learning process is being achieved from 
very different perspectives and through an extensive range of formulas, albeit with one 
common denominator: the use of practices whose origin and pedagogical foundations lie in 
distance education. 

The discussion of the definition and practices of e-learning focuses on the intersection of 
education, teaching, and learning with ICT (Friesen, 2009). It is undoubtedly preceded by 
two other disciplines: educational technology and distance education. Both have signifi¬ 
cantly contributed to the intensive use of ICT for educational purposes, but neither can be 
strictly equated with e-learning. 

E-learning could also be considered a natural evolution of distance learning, which has 
always taken advantage of the latest tools to emerge in the context of technologies for struc¬ 
turing education. In fact, some authors consider e-learning to be a new generation of dis¬ 
tance education, even as they point to significant differences between the two and highlight 
a key starting point: “E-learning does not represent more of the same (...) [It is] about doing 
things differently” (Garrison & Anderson, 2003, p. 7). 

However, the suspicion that different meanings or definitions of e-learning are conditioned 
by particular professional approaches and, more importantly, by particular individual or 
corporate interests underscores the need to analyse this field of knowledge. 

Studies attempting to provide inclusive, or umbrella, definitions of concepts are quite com¬ 
mon in the social sciences and psychology (Castle, 2000; Eagly & Chaiken, 2007; Jones, 


Vol 13 | No 2 


Research Articles 


April 2012 


146 








Building an Inclusive Definition of E-Learning: An Approach to the Conceptual Framework 


Sangra, Vlachopoulos, and Cabrera 


1999; Waddington, Badge, & Bull, 2005). In the educational sciences, studies from different 
knowledge areas can also be found that aim to define concepts used with different meanings 
by the scientific community (Allen, 2004; Baker, 1979; Garavan, 1997; Stanovich, 1998; 
Wright, 2002). Finally, it is worth noting that in the field of distance education, important 
studies have been conducted with a view to defining similar concepts to e-learning (Keegan, 
1980,1988; Garrison & Shale, 1987). These studies offer proof that there has, since the very 
emergence of distance education, been a need to create a common frame of reference for it. 

An agreement on how to define e-learning could help research and researchers go forward in 
identifying models and practices for applying e-learning and in determining the key factors 
for better and more effective use of this type of teaching and learning: “There is a pressing 
requirement to understand better the nature of e-learning, as an educational innovation, 
and to evolve contextually derived frameworks for change which align with organisational 
culture and practice” (Rossiter, 2007, p. 93). The challenge of finding a single, inclusive 
definition of e-learning is the starting point for this study. As Renold and Barter (2003, p. 
91) stated, an inclusive definition is “a broader definition that encompasses a wider spec¬ 
trum of the concept and can cope with the complexity of its representation/characteristics.” 

Research Design 

The main aim of this study was to create an inclusive definition of e-learning that would be 
accepted by the majority of the scientific community and would also define the boundaries 
for future activity in this sector. Two main research activities were carried out to achieve 
this aim. 

1. An extensive literature review: Indexed and peer-reviewed journals, government re¬ 
ports, web pages, and books were considered and analysed. The main objective of this 
activity was to collect the available definitions of e-learning in order to compare and 
categorise them according to their main perspective and focus. 

2. A Delphi survey: Online questionnaires were sent to recognised experts in the field of 
education and ICT in order to determine their perceptions of and beliefs regarding e- 
learning with a view to reaching a final consensus and creating an inclusive definition. 
The entirety of this second research activity was monitored and evaluated by educa¬ 
tional research methodology experts from the Netherlands, Spain, and Canada. 


Literature Review 


A literature review is understood as a description of the relevant literature on a particular 
field or topic (University of Canberra, 2006). The topics used for this review were e-learn¬ 
ing and definition, and the search was performed in the field of education and ICT. 

The search was limited to literature published in or after 2005 as for a new concept such as 
e-learning that is characterised by constant change, it was considered preferable to work 
with papers published in the last five years. However, definitions of e-learning dating from 
before 2005 were considered when designing the research as some of these definitions have 
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provided the basis for newer ones. 

Three main sources of literature were used for the review: 

1. academic and scientific journals indexed in the Social Sciences Citation Index (ISI Web 
of Knowledge) in or after 2005; 

2. books and book chapters, government reports, and doctoral dissertations related to 
education and ICT and e-learning, published in or after 2005; and 

3. open virtual spaces (e.g., blogs, institutional web pages, glossaries) by recognised au¬ 
thors, where education and ICT and e-learning are analysed and discussed. 

The definitions gathered from the literature review focus on different elements of e-learn¬ 
ing. Specifically, four general categories of definitions were identified: 1) technology-driven, 
2) delivery-system-oriented, 3) communication-oriented, and 4) educational-paradigm- 
oriented. 

Technology-Driven Definitions 

This category mostly includes definitions from private companies and a few academics that 
emphasise the technological aspects of e-learning, while presenting the rest of its character¬ 
istics as secondary. The definitions in this category portray e-learning as the use of technol¬ 
ogy for learning. Representative samples of this category include the following. 

• “E-learning is the use of electronic media for a variety of learning purposes that range 
from add-on functions in conventional classrooms to full substitution for the face-to- 
face meetings by online encounters” (Guri-Rosenblit, 2005). 

• “E-learning is to take a course online using a modem, wireless, or cable connection to 
access academic course material from a computer, phone, or handheld device” (Gover¬ 
nors State University, 2008). 

• “E-learning is distance education through remote resources” (Marques, 2006). 

• “E-learning is the use of technology to deliver learning and training programs” (E- 
learning portal, 2009). 

Delivery-System-Oriented Definitions 

This category presents e-learning as a means of accessing knowledge (through learning, 
teaching, or training). In other words, the focus of these definitions is the accessibility of 
resources and not the results of any achievements. Representative samples from this cat¬ 
egory include the following. 

• “E-learning is the delivery of education (all activities relevant to instructing, teaching, 
and learning) through various electronic media” (Koohang & Harman, 2005). 
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• “E-learning is an on-line education defined as the self-paced or real-time delivery of 
training and education over the internet to an end-user device” (Lee & Lee, 2006). 

• “E-learning is the delivery of a learning, training or education program by electronic 
means” (Li, Lau & Dharmendran, 2009). 

• “E-learning is defined as education delivered, or learning conducted, by Web tech¬ 
niques” (Liao & Lu, 2008). 

Communication-Oriented Definitions 

This category considers e-learning to be a communication, interaction, and collaboration 
tool and assigns secondary roles to its other aspects and characteristics. Representative 
examples of these definitions, which come mostly from the academic and communication 
sectors, include the following. 

• “E-learning is education that uses computerised communication systems as an envi¬ 
ronment for communication, the exchange of information and interaction between stu¬ 
dents and instructors” (Bermejo, 2005). 

• “E-learning is learning based on information and communication technologies with 
pedagogical interaction between students and the content, students and the instructors 
or among students through the web” (Gonzalez-Videgaray, 2007). 

• “E-learning is defined as learning facilitated by the use of digital tools and content that 
involves some form of interactivity, which may include online interaction between the 
learner and their teacher or peers” (Ministry of Communication and Technology of 
New Zealand, 2008). 

Educational-Paradigm-Oriented Definitions 

This category defines e-learning as a new way of learning or as an improvement on an exist¬ 
ing educational paradigm. The majority of the authors falling into this category work in the 
education sector. Some of the most representative examples of these definitions include the 
following. 

• “E-learning is the use of new multimedia technologies and the Internet to improve the 
quality of learning by facilitating access to resources and services, as well as remote 
exchange and collaboration” (Alonso et ah, 2005). 

• “E-learning is a broad combination of processes, content, and infrastructure to use 
computers and networks to scale and/or improve one or more significant parts of a 
learning value chain, including management and delivery” (Aldrich, 2005). 

• “E-learning is defined as information and communication technologies used to support 
students to improve their learning” (Ellis, Ginns & Piggott, 2009). 

• “E-learning refers to educational processes that utilise information and communica- 
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tions technology to mediate synchronous as well as asynchronous learning and teach¬ 
ing activities” (Jereb & Smitek, 2006). 


Survey of Expert Opinions 


A Delphi survey was used to determine experts’ perceptions and knowledge with a view to 
reaching a final consensus. This method makes it possible to deal with complex problems 
(Linstone & Turoff, 1975), such as the creation of an inclusive definition of e-learning. 

Delphi studies are considered particularly useful in the field of pedagogy (Yousuf, 2007). 
Rieger (1986) reported that 83% of the PhD theses completed between 1981 and 1984 used 
the Delphi technique and concluded that “it seems reasonable to claim that Delphi is con¬ 
tinuing to be a much used tool in the search for answers to normative questions, especially 
in education areas” (p. 198). The Delphi technique, it should be noted, is also widely used 
in the field of emerging education technologies. Some of the most important studies in 
this field based on leveraging established expertise to provide the input for and inform 
such analyses include the NMC Horizon Report series by the New Media Consortium and 
the Educause Learning Initiative (Johnson, Smith, Willis, Levine, & Haywood, 2011), the 
Future of the Internet Report series by the Pew Internet & American Life Project and Elon 
University (Anderson & Rainie, 2008) and the Top Teaching and Learning Challenges 
2009 project by Educause (Little & Page, 2009). 

Online questionnaires were sent to recognised experts in the field of education and ICT. Ex¬ 
perts was understood to refer to people who are partially or fully devoted to conducting re¬ 
search in this field and have published their findings in journal articles, books, government 
reports, theses, and dissertations. The main purpose of the survey was to determine their 
perceptions of the e-learning concept. They were asked to define the e-learning concept, to 
name its main components, and to categorise it among the scientific fields. 

Following a pilot Delphi round, two more rounds were carried out. The surveys contained 
open and closed questions, and respondents were asked to give spontaneous but reasoned 
answers. The pilot round was used to validate the questionnaire with the participation of 
experts in the fields of educational research methodology and education and ICT from the 
Netherlands, Spain, and Canada. Some minor modifications were made based on their rec¬ 
ommendations. 

The first survey round contained a total of 15 questions and was divided into two main 
parts. The first part consisted of 10 demographic questions related to the experts’ age, place 
of residence, sex, studies, academic profile, professional experience in e-learning, and con¬ 
tact details. The second part included a brief summary of the review of the literature on the 
e-learning concept, including a description of the four general definition categories men¬ 
tioned above. Following this introduction, five questions asked the experts for their opinion 
about the conceptual framework of e-learning in relation to the different categories identi¬ 
fied in the literature review. A Likert scale from 1 to 5 (1 = does not represent the e-learning 
concept ; 5 = represents the e-learning concept exactly ) was provided to answer the first 
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question. 

The second question complemented the first since the experts were asked to justify their 
previous evaluation and to explain whether they believed that there was a single category 
able to offer an inclusive definition of e-learning. The third and fourth questions asked 
whether they believed there was any other category of e-learning definitions that had not 
been mentioned in the survey. If so, they were asked to name it and to describe its main 
characteristics. Finally, the last question offered the participating experts an open space for 
comments. 

Based on the above definition of expert and with a view to including participants from all 
continents, an initial list of a total of 103 experts was drawn up. During the first round, 33 
experts answered the survey (32% of the initial population), a number considered satisfac¬ 
tory for an anonymous study conducted online. Table 1 shows the geographical distribution 
of the experts. 

Table 1 

Geographical Distribution of the Participating Experts 


Spain (7) 

Greece (1) 

France (1) 

Puerto Rico (1) 

Norway (1) 

Switzerland (1) 

USA (2) 

Japan (1) 

Germany (1) 

United Kingdom (1) 

Canada (4) 

Australia (1) 

Italy (1) 

Netherlands (1) 

Brazil (1) 

New Zealand (1) 

Total: 33 experts (14 women; 19 men) 


The majority of the experts (85%) were over the age of 45. While they had different edu¬ 
cational backgrounds, most had an educational profile. With regard to their current oc¬ 
cupation, 85% of the participants work as academics or research staff at higher education 
institutions, while the remaining 15% come from the corporate sector. As for the four defi¬ 
nition categories, most respondents (85%) felt that the educational paradigm category best 
represents the conceptual framework of e-learning. Figure 1 shows the average scores they 
assigned. 



Technology Delivery system Communication Educational Paradigm 


Figure 1 . Evaluation of the four definition categories by the participating experts (1 = does 
not represent the e-learning concept; 5 = represents the e-learning concept exactly ). 
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In addition to their evaluations, the experts provided some very useful comments regarding 
how e-learning should be defined and offered important arguments to be considered with 
regard to the construction of an inclusive definition. Their contribution can be summarised 
in four main points. 

1. The quickly changing nature of the uses of technology for teaching and learning must 
be taken into consideration when preparing a definition of e-learning. 

2. E-learning can be used not only for collaborative learning, but also for autonomous, 
individual learning. 

3. E-learning is a means of facilitating the achievement of (formal or informal) learning 
goals. 

4. E-learning is a new learning/training model, a new way to learn. 

In the second round, the experts were encouraged to revise their earlier answers in light of 
the responses of the other members of the panel. Over the course of this process, the degree 
of disagreement was expected to decrease and the group was expected to converge towards 
an agreed statement. 

Nevertheless, they were encouraged to change their opinions only if they agreed with the 
most popular answer and were convinced that it was the most suitable one. Since no major 
differences were found among the experts’ arguments and comments regarding the cre¬ 
ation of an inclusive definition of e-learning, it was considered that one more round would 
be enough to reach a final consensus. 

In this context and after taking into consideration all their comments and arguments, a 
preliminary definition of e-learning was prepared, containing aspects of all four general 
categories. The experts were asked to evaluate it in the final Delphi round. The preliminary 
definition was as follows: 

E-learning is an approach to teaching and learning, 
representing all or part of the educational model applied, 
that is based on the use of electronic media and devices 
as tools for improving access to training, communication 
and interaction and that facilitates the adoption of new 
ways of understanding and developing learning. 

In the final round, experts were asked to use a Likert scale from 1 to 4 (1 = the defini¬ 
tion does not represent the e-learning concept; 2 = the definition hardly represents the 
e-learning concept; 3 = the definition represents the e-learning concept fairly well; 4 = the 
definition fully represents the e-learning concept ) to express either agreement (3/4) or dis¬ 
agreement (1/2) and to check whether their comments had been successfully incorporated 
into the final inclusive definition. The level of acceptance of the definition turned out to be 
quite high, with 31 of the 33 participants evaluating it positively (3/4), for an average score 
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of 3.40. Figure 2 shows the breakdown of the scores. 


Figure 2. Evaluation of the inclusive definition by the participating experts. 


□How would you evaluate 

our inclusive definition? 



Although the consensus regarding this definition was quite strong, the participating experts 
insisted on two basic aspects that should be revisited: 


1. The evolution of the technologies used for learning and teaching should be taken into 
consideration; 

2. The e-learning concept is also based on certain socioeconomic factors that may not 
need to be explicitly included in the definition but should nevertheless be taken into 
account. 


Limitations of the Study 


Although this study was carried out according to the methodology recommended by experts 
in educational research, certain limitations should be pointed out. 

In spite of the fact that the ISI Web of Knowledge database is considered one of the most 
prestigious databases in the world, it does not include all the most important publications 
on e-learning, probably due to the newness of the concept and an existing policy against 
open access journals, which are increasingly used to distribute research on e-learning (An¬ 
derson & McConkey, 2009). Thus, some interesting definitions of the e-learning concept 
published in other relevant journals may have been overlooked. 

Additionally, despite the satisfactory number of participating experts, the sample of experts 
from Asia and Africa was not as large as expected, perhaps due to the strict time constraints 
of the research. 


Conclusions and Further Research 


The results of this study confirm its main research hypothesis about the difficulty of devis¬ 
ing a single, inclusive definition of e-learning that would be accepted by the majority of the 
scientific community due to the existence of different perspectives on this concept based on 
authors’ professional and academic profiles. It was found that the most important reasons 
for this situation are that both the concept of e-learning and society are in a state of con- 
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stant flux and the term is understood from many angles and used with different meanings 
(Stein, Shephard, & Harris, 2011). 

After the analysis of the contributions of the participating experts, the research arrived at 
the general conclusion that e-learning is part of the new dynamic that characterises edu¬ 
cational systems at the start of the 21 st century, resulting from the merge of different disci¬ 
plines, such as computer science, communication technology, and pedagogy, since all the 
collected definitions contained characteristics of more than one discipline. Consequently, 
the concept of e-learning can be expected to continue to evolve for a long time. In today’s 
world, learning needs change very quickly and the concept and functions of e-learning must 
continuously be adapted to these needs. 

Moreover, the difficulty to include all the main features of the e-learning concept in a single 
definition was identified since not all authors made the same use of the concept and they 
considered different aspects as fundamental. In this context, and in order to take advan¬ 
tage of all the definitions created, the need to be flexible and generic enough to include the 
majority of these uses and features is considered compulsory. More analytically, this study 
resulted in an inclusive definition that takes into consideration the four main categories in 
which authors conceptualise e-learning: technology, delivery systems, communication, and 
educational paradigms. 

It is true that there is a risk in adopting an inclusive definition of e-learning because this 
definition connects its different elements and features, which can obstruct the understand¬ 
ing of the concept. But the commonality that unites the concepts is also important, and this 
can be shown only through an inclusive definition which presents the different interrelated 
features (Waddington, Badger, & Bull, 2005). 

As far as the different tendencies of the created definitions of e-learning are concerned, it 
was found that authors with a more technological profile geared their definitions towards 
technology or access systems, while authors with an educational profile focused on the new 
educational paradigm and communication. The participation of e-learning experts from 
different approaches that agreed on this inclusive definition will help enormously to make 
easier its acceptance. On the other hand, the new definition is not threatening any practices. 
It wants to be a common framework for enhancing theory development and empirical re¬ 
search in a community of scientists (Eagly & Chaiken, 2007) and, in this case, developing 
further research in identifying e-learning application models. 

Another conclusion derived from the findings of this study is that e-learning goes far be¬ 
yond technology, even though the concept did not appear until after computers began to be 
used in education. The literature review and the Delphi method applied to the participating 
experts showed that e-learning also refers to the actual learning that takes place when these 
resources are used. In this regard, the experts mainly characterised e-learning as a “way of 
teaching and learning” moving towards a “new educational paradigm.” 

In addition, the framework provided by Jones (1999) is confirmed since this study em- 
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braced a broad and inclusive definition of e-learning in the belief that e-learning is an im¬ 
portant - indeed, a key - issue for all academics and professionals who work and do re¬ 
search in the field of education and ICT. As a result, an inclusive definition of this concept 
enables multiple points of entry into the discussion of e-learning, from its basic compo¬ 
nents to its application and models. In other words, a greater number of individuals will 
see the relevance of, and their personal connection to, the concept and will thus be able to 
access different points of the discussion and implementation. Since e-learning is often per¬ 
ceived as being too abstract for people to understand, an inclusive definition can be used to 
provide the basis, and language, for understanding one’s own connection to the field. It is 
believed that this new definition of the concept could serve as the first step to establishing 
a new framework of reference for e-learning able to boost research activity by providing a 
common starting point. 

Furthermore, the purpose of the new definition is to consider e-learning as a more compre¬ 
hensive concept, in which bias due to the four identified categories leads to identifying dif¬ 
ferent models of application but does not extend to the concept itself. The most important 
advantage is to avoid discussions about the extent to which some practice is e-learning or 
is not. The core question will explain which kind of e-learning model is being applied and 
what its aims and potential benefits are in a particular context. This should help give the 
e-learning concept more consistency, which will enable working on the establishment of a 
pattern for analysing e-learning models that should result in more arguments in favour of 
the potential achievements of e-learning. 

Finally, the contribution of an inclusive definition to the evolution of terminology shouldn’t 
be ignored. The importance of updating different concepts was underlined many years ago 
(Allport, 1935) since it helps to reach a convergent point to start a new journey on the con¬ 
cept. 

As Bates and Poole (2003) suggested, it would also be worth considering that there are 
different types or forms of e-learning and even different models of applying it. Further re¬ 
search should also focus on both the specific and common characteristics of these e-learn- 
ing models and on the contexts in which they might work best. 
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